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ABSTRACT 

Discrete approximation schemes for the solution of nonlinear hereditary 
control problems are constructed. The methods involve approximation by 
a sequence of optimal control problems in which the original infinite 
dimensional state equation has been approximated by a finite dimensional 
discrete difference equation. Convergence of the state approximations is 
argued using linear semigroup theory and is then used to demonstrate that 
solutions to the approximating optimal contrcl problems in some sense 
approximate solutions to the original control problem. Two schemes, one 
based upon piecewise constant approximation, and the other involving spline 
functions are discussed. Numerical results are presented, analyzed and used 
to compare the schemes to other available approximation methods for the 
solution of hereditary control problems. 
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Introduct ion 


The purpose of this paper is two-fold. It first serves to describe 
how the abstract approximation framework developed for the integration of 
linear functional differential equation (FDE) initial value problems la 
[24] can be extended so as to be applicable to certain nonlinear problems 
as well. Secondly, the application of the resulting approximation schemes 
to the generation of approximate solutions to optimal control problems in 
which the dynamics of the underlying system are governed by . nonlinear FDE 
is discussed. 

The approach we take is not new. We consider the nonlinear FDE in 
an equivalent form, l.e., as an implicit abstract evolution equation in an 
infinite dimensional Hilbert space Z. We then construct a sequence of 
finite dimensional approximating discrete difference equations by approximating 
the solution semigroup of operators (and its infinitesimal generator) defined 
by the linear part of the equation using piecewise constant or spline based 
subspaces of Z . Linear Semigroup Theory and discrete analogs of the 
Trotter-Kato Theorem [l8j and the well-known Gronwall inequality are then 
used to argue convergence. Approximate solutions to the optimal control 
problem are generated by considering a sequence of approximating optimal 
control problems in each of which the infinite dimensional FDE state 
equation has been approximated in the spirit of the discussions above. 

Using the fact that the state approximations converge, we are then able to 
demonstrate that solutions to the approximating optimal control problems 
(which can be solved by conventional methods) in some sense approximate 
solutions to the original control problem. 

Banks and Burns [3][4] were among the first to propose the idea of 
approximating hereditary control problems by a sequence of finite dimensional 
approximating control problems. The semi-discrete methods for problems with 
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linear state equations which they developed were lai^r extended by 
Banks [2] so as to be applicable to nonlinear problems as well. Using 
similar approaches, Reber [21] and Rockey [23] developed fully discrete 
schemes for the approximation of FDE which they then applied to the 
solution of control problems. Reber developed first order convergent 
schemes for linear nGn-^autonomous equations. In the constant coefficient 
case, his work becomes a special case of the more general theory to be 
presented below. In [23], the linear or nonlinear FDE Is first recast 
as an equivalent Volterra integral equation in > and is then discretized 
using piecewise constant or spline subspaces. An algebraic system for the 
Fourier coefficients of the solution results which is then solved using 
standard methods. Recently, within the context of the framework developed 
in [3], Gibson [13] and Kunisch [20] have formulated semi-‘discrcte approxi- 
mation schemes which yield approximating closed loop solutions to the linear 
quadratic control problem with hereditary system dynamics. 

The discussion of our results below closely parallels the presentation 
in [2]. The treatment in [2] relies heavily upon the linear theory developed 
in [3] and [4] by considering the nonlinearities (which are assumed to 
satisfy local Lipschitz and affine growth conditions) to be a perturbation 
of the linear part of the equation. Since the basis for our approximation 

At 

schemes involves the approximation of the solution semigroup e using 
rational function approximations to the exponential and finite dimeiislonal 
approximation of A, we too depend heavily upon the linear theory, and 
hence consider precisely the same class of equations which are studied in 
[2]. An unfortunate consequence, however, is that this precludes the 
inclusion of nonlinearities in the discrete delay terms (i.e. terms of 
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the form x(t-r))* This is in contrast to the work of Kappel and Sehappacher 
[17] and Kappei [16] and the recent paper by Daniel [10] in which the hon^ 
linearities in the equation are handled more directly and which do permit 
discrete delay terms to enter into the equation in a nonlinear fashion. The 
convergence arguments for the approximation schemes developed in [16] and 
[17] are based largely on ideas from nonlinear semigroup theory and 
approximation results analogous to those used in the linear case. Daniel, 
on the other hand, avoids the semigroup approach entirely and relies Instead, 
directly upon the dissipative properties of the nonlinear operators arising 
in the abstract formulation of the FDE in order to argue the convergence 
of spline based semidiscrete approximation schemes. These results are 
obtained, however, at the expense of requiring somewhat stronger assumptions 
(global Lipschitz and additional smoothness) on the nonlinearities in the 
equation and the placement of additional restrictions on the class of 
admissible controls. 

We conclude this section with an outline of the rest of the paper and 
a brief description of our notation. In Section 2 we define the nonlinear 
FDE with which we shall be concerned and state the hypotheses it must satisfy 
in order for us to carry out our analysis. We also state fundamental 
existence and uniqueness results and describe the equivalent formulation 
of the FDE as an abstract evolution equation in the Hilbert space Z .In 
Sectioa 3 we first recall the abstract approximation results for linear 
equations discussed in [24}. We then extend them so that they are applicable 
to the nonlinear equation as well and state and prove the fundamental 
convergence result. In Section 4 we briefly describe the details involved 
in the construction of actual schemes to which our general convergence 
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results apply. We also outline two specific schemes, one using piecewise 
constant functions and the other using splines. Section 5 contains the 
results pertaining to the application of the approximation scheBea to the 
solution of optimal control problems while in Section 6 we demonstrate 
the feasibility of our methods by presenting and analyzing several numerical 
examples. 


The notation we use. Is, for the most part, standard. The superscripts 
on the Lebesgue spacevS L®(a,b), the space of functions with p continuous 
derivatives Cp(a,b) and the Sobolev spaces H^(a,b) denote that they 
consist of functions (or equivalence classes of functions) defined on 
(a,b) with range in . The symbol is used to denote the class 

of functions which are locally essentially bounded. The space of continucus 
functions from an interval (a,b) with range in the abstract space Z is 
denoted by C([a,b3,Z) . We assume that this space is endowed with the usual 
supremum norm. For a linear operator A and a complex number A contained 
in the resolvent set of A we denote the resolvent of A at A by 


R(A;A), 



In this paper we consider nonlinear hereditary control systems which 
are governed by functional differential state equations of retarded type 
of the form 


(2.1) x(t) * Lx^ + f(t,x(t) ,x^,u(t» t e [0,T] 

with initial conditions given by 

(2.2) x(0) ** n x^ « 9 
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where n c 4> ^ L^C-rjO) and denotes the function on [-r,0]I 

defined by x (0) = x(t+9), -r s 6 iS 0. The linear part of the equation, 
given by the linear operator LtL^C-rjO) r” will be assumed to be of the 
form 



V 

I 


j=0 




fO 

A(0)4>(e)d0 

<1 

-r 


where the are nxn matrices, A(*) is a square integrable nxn matrix 
valued function defined on the interval (-r,0) and 0 — ^ * 

Strictly speaking, L(f) is not well defined for all € L^C-rjO) in that 
point evaluations of (j) are required* We remedy this situation by insuring 
that in any instance in which the operator L appears below, either it is 
being applied to an element in L 2 (*~r, 0 ) for which the value of L<}> is 
well defined, or L(j) appears either explicitly or implieltiy beneath an 
integral sign in a reference to x, the solution to the initial value 
problem (2.1) (2.2) above. 

In addition, we assume that the nonlinear perturbation term 
f :R^R^xL 2 (-r, 0 ) R^ satisfies the following hypotheses 


(HI) The mapping <t,ri, <^, v) f(t,n,(pyV) 

is continuous on R^xR^xL^(-r ,0)xR® 

(H2) For any bounded subset V of R^ xx,^(-.r,0) 

loc 

there exist ~ m^(P) , c 1 « 1,2 

such that for v € t € R^ and (nv4>) >(£»#) c V 
one has 

|f (t,n,4).,v) - f <t,C,tf/.,v) I i {mj^(t)+m 2 (t) |v|H|n-Cl+l<l>"'|^l} 
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(H3) There exists a continuous nxm loatrix valued mapping t B(t) 
such that f(t,0,0>v) =* B(t)v for all t e and v e In 

addition there exist functions m, e i - 1,2 such that 

cx> 

lf(t,n,<l> , v) I<{m^(t) -J-m^Ct) lv|}{!n| + |$ 1 }+ iB(t) jlv) 

for all t € R^, V e and all e R*^xL”(-~r,0> with 

](n»W |nl^+ !<t!^ sufficiently large. 

Inn 1 

(H4) There exists a continuous function g:R xR xL^C-rjO) ^ R such that 
lf(t,n,(|).v) - f(t,n,<{>»w) 1 i g(t,n.4i) Iv-w] 
for all t € R^, r)€ R”> 4> e L^C-r,©) and v,w € R™. 

Hypotheses (H2) and (H3) together yield the follov/ing growth condition 
satisfied by f : 

^ ^ loc 

(G) There exist functions in- ,m^ e such that 

|f (t,n,<|>,v) I e {in^(t)+m2(0 tln!+kl}-^ ^(t) ] jv! 

for all t £ R^ , n € R'^* € L^C'-r jO) and v £ R®. 

A solution x(t) - x{t;n,<(>,u) to (2.1) (2,2) is defined to 
be a function x £ L^C-r,!) such that the mapping t ^ x(t) is absolutely 
continuous on (0,T), (2.1) is satisfied a. e. on (0,T) and for which 
x(0) ® n Xq = . Using standard arguments, the following existence, 

uniqueness and continuous dependence result for solutions to the initial 
value problem (2,1) (2.2) can be established. 

Theorem 2.1 Under hypotheses (HI) - (H4) , given u e L^(0,T) and 
(n,4>) £ R^xH^(-r,0) with n == 4(0), there exists a unique solution to the 
initial value problem (2.1) (2.2) on [0 ,t 3. Moreover, the mapping 
(4>,u) (x(t;4)(0) ,<|),u) ,x^(<^(0) ,4,u)) from (-r,0) x l^CO,!) into R”xL 2 (-r, 0 ) 

where x Is the unique solution to (2,1)(2.2) corresporfing to U£L 2 ( 0 ,T) 
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and x(0) ~ 4>(0), =® <I>, is continuous with respect to the topology on 

H^(~r,0) xL 2(0,T) induced by the supremum norm on H^(-r,0) and the standard 
norm on L®(0,T)* 

Fundamental to the development of our approximation schemes belot^ will 
be the equivalence which exists between the FDE initial value problem 

(2.1) (2.2) above and an abstract evolution equation set in the Hilbert space 

2 « R”xL^(-r,0) with inner product <•, - <•>•> + <•,•> 

^ r" T.^r-r.O) 

i. 

For each t ^ 0 let S(t):2 2 denote the solution operator for the 

associated linear homogeneous initial value problem corresponding to (2.1) 

(2.2) . That is, for e 2 we have 

s(t)(n,<Jj) = (x(t),x^) 

where x is the unique solution to (2,1) (2.2) with f = 0. Based upon 
existence, uniqueness and continuous dependence results for the linear 
homogeneous problem (see [3][4]C24]) one may conclude that {S(t):t ^0} 
represents a parameterized family of well defined bounded linear transform- 
ations forming a CQ-semigroup of operators on 2. The infinitesimal 
generator of {S(t) :t S0} , A , and its domain of definition 0(A) may 
be calculated and are given by 

D(A) = {(n,<}))eZ;T]»(|)(0),4)eHj(-r,0)} 

A(<J>( 0 ),(})) = 

If we define the inner product <•,•> on 2 by 

0 ® 

<(n,4').<C.'l>)>g = + I 4>(e)’^ii/(e)g(e)d6 

-r 


where 
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-r 


-T, 


V-1 


^ 9 < ■'v- 
^ 0 < "fv- 


1 

2 


T j^ s e s 0 


then it clearly follows that for e Z 


Furthermore, it can be shown that the operator A satisfies the following 
dissipative inequality with respect to the g inner product: 


( 2 . 3 ) 


^ S’ Vg ^ “ %’Vg 


V 

with m = ^'+ IAqI + 1/2 I lA^l^ + 1/2 j lA(e) 1' 

^ ^ -r 


d6 


and. hence A e G(/!7,a3) ~ that is, the semigroup of operators {S(t):t iO} 
satisfies the exponential bound given by 


|S(t) I 5 /v e“^. 

Let ^ L2(-*r,0) denote the two coordinate projections 

of Z onto and L^C-rjO) respectively. That is for ^ 2, we 

have 

7T^Cn,<J>) » n 

Let the mapping F;R^xZxr™ ^ Z be defined by 



. . .-^1 • . rr%sa*m •%# 

;’ ;; : ^ ph quality 

9 

Hypotheses (H1)-(H4) imposed upon f naturally imply that the mapping F 
defined above will have the following properties: 

(PI) For any z e C([0,T],Z) and it c the mapping 

t |F(t,z(t) ,u(t)) I is in L^(0,T) . 

(P2) For any hounded subset V of Z, there exist 

on P) in such that |F(t,z^v) - F(t,w,v) | ^ 

(M^(t) + M 2 (t) |v|} jz-w| for all z,wc P , t € and v € R®. 

For e Z and u e L2(0,T), let the mapping z:[0,T] -*■ Z be defined 
implicitly by the following expression 

(2.4) z(t) « z(t;z^,u) « S(c)z^ + | S(t-a)F(a,z(a) ,u(a))da . 

0 

Using hypotheses (H1)-(H4) and properties (PI) and (P2) above together 
with standard arguments involving Picard iterates and the Gronwall inequality. 
Banks [2] is able to establish the following leimaa. 

Lemma 2,1 Under hypotheses (H1)-(H4), equation (2.4) above, defines for 
each Zq € Z and u e L®(0,T) a unique function t z(tfZQ,’i) c C (tO,T],Z) . 
Moreover, the mapping (4>(0) ,({),u) z(t , {(J>(0) ,4)) ,u) is continuous on 
D(A)>^L 2 ( 0 ,T) with respect to the ZxL^ and R^x(fx L^^ topologies. 

Finally, using the above results, the equivalence which we desire between 
the FDE initial value problem (2,1) (2.2) and an abstract evolution equation 
set in Z, In particular the system given by (2.4), can be established. 



10 


0R105MAL g 
OF POOR C-JALCn 

Theorem 2.2 For f satisfying hypotheses (H1)-(H4), = (<t>(0),y) c D(A) 

and u e L^CO.T) we have 

V/.5J z(t;zQ,u) = (x(t;(fi(0) ,4>.u) ,Xj.((|)(0) ,<J),u)) t e C0,T] 
where z(t;zQ,u) is tK unique solution to (2.4) guaranteed to exist by 
Lemma 2.1 and x(t ;(j)(0) ,c|),u) Is the unique solution to the FDE initial 
value problem (2.1) (2.2) guaranteed to exist by Theorem 2.1. 

We shall onl> briefly outline the essential aspects of the arguments 
necessary to verify Theorem 2.2. The details of the proof can be found 
in [2]. The equivalence described by (2.5) is first established on a 
restricted class of initial data and input functions u ^ For 

(<}>(0)»<(>) € Z with <|)€ C^(-r,0) and u € c”^(0,T) it can be shown that 

w(t) « (x<t;(|>(0),(|),a^,x^(4)(0),((),u^ 

is the unique strong solution to the aus tract evolution equation in Z 
given in differentialed form by 

(2.6) f(t) - Ay(t) + F(t,y(t),u(t)) 

(2.7) y(0) - ((})(0),<f>) 

However, it can also be shown that any strong solution of (2.6) (2.7) 
corresponding to ({) e C^(-r,0) and ue c’^(0,T) must satisfy 

y(t) = S(t)y(0) + I S(t-a)F(o,y(a),h(o))da 

0 

and hence by Lemma 2.1 must be the unique solution in C(tO,T],2) of (2.4). 
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There f ere > we have that 

z(t,(<J)(0) ,$) ,u) <=> w(t) = (x(t,4)(0) ,x^{MO) ,(|),u)) 

With the desired equivalence now established for ^ C?(-r,0) and 

X ' 

u € C^'cOjT), it is easily extended to the inore general class of in'.tial 
data and inp^ut functions described in the statement of the theorem througl 
the use of the continuous dependence results given in Iheorem 2.1 ar.c^. 

Lemma 2,1 together with standard density arguments. 

3 . An Abstract Approximation Framewo rk 

In this section we develop an abstract approximation framework *^nder 
which approximation schemes applicable to the abstract evolution eouation 
given by (2.4) can be constructed. In addition, we establish conditions 
which are sufficient to conclude convergence of schemes constructed within 
the framework. The approach we take is based upon, and an extensio^t of, 
the discrete approximation framewo’^k for the integration of linear FDE 
initial value problems described in [24]. Indeed our schemes will b based 
upon the approximation of the semigroup of operators {S(t):t^O} definea 
on Z by a sequence of discrete semigroups (see [18]) which are defined on 
finite dimensional approximating subspaces of and wMch are constructed 
using rational function approximations to the exponential end finite 
dimensional approximations to the infinitesimal generator A of {S(t):t ^O}. 
The fundamental convergence results for these constructions are given in 
Theorem 3.1 to follow and are used extensively throughout our discussions 


below. 
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For each N = 1,2,,, let be a finite dimensional subspace of Z 

of dimension and let be the associated orthogonal (not 

necessarily with respect to the standard inner prcduct on Z ) projection 

of Z onto Z„. Define A^,:Z^, Z„ to be a bounded linear operator on 
^ At ** ^ ^ 

and let S^(t) - e ‘ for all t ^ 0. 

Theore m 3.1 Suppose 


(1) 

P „2 z as N » for each z € Z 

N 


(2) 

There exist constants 

M,3, independent of 

N for which 


A,Aj, € G(M,3) , N - 1,2 

. . * ( i . e . 



lS(t) l S Me^S lSjj(t)] 

£ Me^*^ N = 1,2> .. 

) 

(3) 

There exists D^cD(A) , 

a dense subset of Z 

for which 


|Aj^Pj^z - Az 1 0 as N 

^ for each z e 



(4) There exist Xe C with ReX > 3 and a dense subset of Z 

for which R(X;A)D 2 E 


(5) C( 2 ) is a rational function of the complex variable z for which 

(a) |c(z) - 1 ~ 0(|z|^^^) as [z| 0 with q > 0 

(b) if C(z) « n(z)/d(z) then 

degree C(z) H degree n(z) - degree d(z) < q + 1 

(c) C(z) has no poles in {z6C:Rez^0) 

Then the operators ^ exist for all N sufficiently 


large. If, in addition, for p. 


N 


that positive integer for which 


r r 

N ~ have that the infinite collef tion of operators 


on Z 


N* 


{ r k ' P 

Cfc A„) N are uniformly bounded with respect to N then 
“ )k=0 
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(3.1) |C(| - S(t^)z| ^0 

as N “ for each z e Z uniformly in k, k = 0,1,2...''^^ where 

tf = k ^ k = 0,1.2. . .p,, . 

Theorem 3.1 is based primarily upon a result due to Hersh and Kato [14] 
and is in fact a fully discrete analog of the well known Trotter-Kato 
results which are commonly used in establishing the convergence of semi- 
discrete approximations to semigroups of operators (see [18]) . That it is 
possible to actually construct schemes (l.e. C(z)) which 

satisfy the hypotheses of Theorem 3.1 is exhibited in the next sectio. . 

Remark 3.1 As a corollary to Theorem 3.1, it is possible to estimate the 
rate of convergence in (3.1). Indeed if for z € S, a particular subset 
of Z which is defined in Theorem 4.17 of [24] we have that the convergence 
in Hypothesis (3) is for some p > 0, then the rate of convergence 

in (3.1) will be 0('~)^ + 0(^)^ for z € S. 


Before we can proceed to apply the results of Theorem 3.1 in the 
de ve lopme n t of ap p r o x ima ti on schemes f or the non 1 inear s y s t em (2.4), we 
must first consider the linear nonhomogeneous problem. We shall require 
the following result from [24]. For f e L^(OvT) and € Z, let 
z € C([0,T],Z) be given by 


t 


z(t) == S(t)z^ + j 
0 


S(t-o) (f(o),0)da 


and let 




k=0 


c Zjj be given by 


^ ^ ^ '^D(X A^)P^(f ^ , 0) 


d=i 


N W 


N r 



where 


f I 


is 


OF POOR QUALITY 

f(o)da , D( 2 ) is a rational function of the complex 


a-i)f 


variable z and 0 5 X 5 1. 


Theorem 3*2 Suppose that Z^, P^, A^, C(z) satisfy the hypotheses of 
Theorem 3*1. Suppose further that 

(1) The Infinite collection of operators on 

I C(-^ ^ uniformly bounded with respect to N 


and 


( 2 ) 

Then 


The operators D(X-|^ exist for all N sufflcently large and 

satisfy |d(X-§ A„)P„z - zI as for each z c Z. 

N U N ' 


- z(t^) j ■> 0 

as N 00 for each e Z uniformly in k, k = 0,1,2. and uniformly 

in f for f in bounded subsets of L 2 ( 0 ,T) . 


Several of our arguments below rely upon an application of the following 
lerama. The result given in Lemma 3.1 is a discrete analog of the well known 
generalized Gronwall differential inequality. Since we have been unable to 
locate a suitable reference in the literature, a proof of the result has been 
included. 


Lemma 3.1 Suppose that {cx^ }?^q and are sequences of non-negative 

real numbers and that a sequence of real numbers which satisfy 


n--l 

^ " k=0 




1 , 2 .., 


Then we have that 




15 


n-1 n-1 

^ ^ 3.a.'exp( I ^ “ 1,2... 

j=0 J ^ k=j+l 

If in addition = a s 0 j ® 0,1,2 ... then 

n-1 

<t> £ a exp( J, 3 .) n * 1,2, ... 

" k=0 

n-1 

Proof ; Let s = ^ 3^<J>. n = 1 , 2 ... Then 

XI t rv IC iC 

k=0 


n -2 


s - s , = 6 1 ^ 3 ,(ot , 4- y 3, 4 ^ 1 ) “3 ,(cx - , s ,) 

n n-1 n-1 n-1 n-1 n-1 , k^k n-1 n-1 4- n-1 

k=0 


and therefore 


s ^ (1 4 - 3 „ J s 4-3 ,a . 

n n-1 n-i n-1 n-l 


This Implies that 

n-1 n-1 n-1 

(3.2) ^ H (1 + 3. )s, + 5: n (14- 3, )3,a, 

n ± k-j4-l ^ ^ J 


k^l 

n-1 

1 

k= 

n-1 n-1 


n-1 n-1 


n (1 + &i,)^o“o ^ ^ 

,=1 k U u k j 3 

-1 n-1 

I n 

j«0 k«j4-l ^ J 


Now ^ 0 implies that (1 4- 3^^) ^ exp(3^) k “ 1,2... n-1 and hence 


n-1 n-1 n-1 n-1 

S_ ^ I 3,0 ( n . exp( 3 . )) *• I 3,0 (exp ( J 3 . ) ) 
j«0 J ^ k=j+l j=0 J J k=J+l ^ 


from which we conclude that 


n-1 


n-1 


**’n ^ '^n ®n ^ ^ 3,0 (exp ( ^ 3.)). 

j«0 ^ ^ k«j4-l ^ 


In the case that » a, j “ 0,1,2..., (3.2) implies that 
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n-l n-1 n-1 n-1 n-1 

J S a I li n (1 + e ) = a I ( n <i + b. ) - n (i + b, » 

j=0 ^ k=j+l j=0 k=j ^ ^ 


= a(( n (1 + B. )) - (1 + 3„ J) 

k=0 ^ 


s a(( n exp(B, )) - (1 + 3„ J) 
k=0 


« a(exp( I B ) - (1 + B„ ,)). 
k=0 


Therefore 


<)>jj ^ a + ®n ^ ^ ■ ^n-1^ 

n~l 

*■ a(exp( I B„) - B„ ,) 
n n-1 


S a exp ( I B, ). 
k=0 


For Zjj, Py, Ajj, C(z), D(z) and as described above, Zq e Z, 

u € L^(0,T) and f satisfying hypotheses (HI) - (H4) we define the collection 


Zn b y 




k « 0,l,2...p^ 


ri ^ I L 

** F(cJ,Zi_i,u(a))do = ,tt„z“ , 

) x-x r ) X i-i z x-1 


u(o))da, 0 ) 


(i-l)f 


^ T 

(i-i>5 


i 1 » 2 • • * p 



dRlGSNAL FA6f 15 
OF POOR QUALITY 


17 


Lemir.a 3.2 For P^, C(z), D(z) and Pj^ satisfying the hypotheses 

of Theorem 3,2 and u e E , a bounded subset of L^CO,!), the collection 

I I defined by (3.3) above are bounded in (><\, |j *|i^) uniformly 

' ' k=0 0 

in K for all N sufficiently large and uniformly in .u-c E where 


II {^1 


N (iN - i ^1 

,= raax |z, | 

k=0 «> O^k^p Z 
n 


{ XT k) 

C(^ Ajj) I 

k«0 

for all N sufficiently large which is assumed to exist in hypothesis (1) 

of Theorem 3.2, and let denote the unifora bound on the operators 

D(A ^ A^) for all N sufficiently large whose existence can be argued using 


hypothesis (2) of Thecrem 3.2 and the uniform boundedness principle. Then, 
for k ^ 0, 1.2. . .p„ 

k 


I'kl ^ “olvl^lVx lv?l 

iJL 

k pN 

^ Vi ^ J r lf(o,F^z^^^.Tr2z”.^,u(a))Ida. 

j»l j 1^ 


Applying the growth condition (G) satisfied by f, we find 


i**i 


^ K Iz I + K^K |b 1 lu| 

U U 0 1 L®(0,T) 

^ |n 

+ KqK^ I {bi2“.il + IVj-ll^ J (fii(o) + ra2(cJ)lu(0) |) 

-I .li 

J ‘‘■M 
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^ nxm l“l m + 

u u yi L^CO.T) 

P. 


"N, „ , f^N 

^n I 1 z”_^| J + S^Co) lu(o) ]) da , 

1 - 1 — 

J -^ N 


and hence by Lemma 3.1 

t\l ^ (Kfll vt VJ®! 


W\ ) 

lJ"^®(0,t) t,J{0.t) 


exp(/2 KqKj^ J nij^(o) + m^Ca) |u(0) jda) 
0 


^ CKqIzo! + ^Kl!®! nxm m 

U U U 1 l^><®(0,T) L^CO.T) 


exp(/2 K K,dm Lt + IS,!, T^''^W ^ ) 

01 1 I L^CO.T) 


Theorem 3.3 For 2^, P^, A^, C(z), D(z) and satisfying the 


hypotheses of Theorem 3.2, u e E , a bounded subset of L^CO,!), 

{ N 1 

z, { given by (3-3) , and z given by (2.4) we have 
- ^ k-0 


as N ->" «> for each c 2 uniformly in k, k « 0,l,2,..p^ and uniformly 
in u for u e E. 


Proof For z e C([0,T], Z), the unique eolutica to (2.4) guaranteed to 
exist by Lemma 2.1, and t e C6,T3 define the function h by 

h(t) « h(t,u) =* f(t,TT^2(t),7r2z{t),u(t)). 
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Then 


z(t) = S(t)z 


<u 

Q + I S<t-a)<h(o),0)da 
0 


and using hypotheses (H1)-(H4) It is easily verified that for u e E, 

,Px 


h lies in a bounded subset of l"( 0,T). If we define ( z!^ | 

^ t *' ^k=0 

.N 




where 


j-i 

h(a)da then it follows that 


i-1 


- z(t»)| s |4- 5»| f li“- -(cjl 

l\ - I + 

1 *.N 

K ft 

KqK^ lf(Cf,Tr^zJ_j^,Tr 2 z”_j^,u(a)) - f (0,irj^z(o) .tt^zCo) ,u(o)) jdo 


-j-1 

l~N ,^Nx| , 


k-1 t^ 

I K_K f ^■^^|f(o,z^,u(o)) - F(r/,a(a),u(0)) |d0 
j=0 ^ {n J 


where and are as they were defined in the proof of Lemma 3,2. 

Since {z(t; z^,u) : teCp,T3,u £ E} lies in a bounded subset of 2 (see [2]) 
as does {z!^(z^,u), k « 0,l,2...p uc E} uniformly in K fcr ail H 
sufficiently large, property (P2) implies 

I N > N. , ^ ,^N , Nv , 

' '^k " I 

k-1 et^ 

I K-K (M,(0) + M,(0) |u(0) 1) [z^ - z(0) |d0 

j=0 ^ ^ J N ^ J 


(3. A) 
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k-1 , 

S jz^-z(t^)i + I I (Mj^(a) + M2(0f)!u(a)l)' 

j=0 

i- J 

.N^ 


k-1 
j 


|z(tp - z( 0 ) Ida 
.N 


Vl - z(tj) 1 • 


i^N N I 

Let e > 0 be given. Theorem 3.2 implies that \zy^ - zit^) \ < e for 
all N sufficiently large uniformly in k, k « 0,l,2...p^ and uniformly 
in u for u e E. Furthermore by Theorem 3.2 of C3], the operator 
Fa^CO.T) -> C(C0,T],Z) defined by 

fb 

F(f)(t) = S(t)zQ + ! S(t-o)(f(a),Q)do 
0 

is a compact affine operator. Since u c E , a bounded subset of 
L^CO,!) implies h(*,u) lies In a bounded subset of l”( 0,T), it follows 
that {z(*5ZqU);u e E} is a relatively compact subset of C([0,X],Z). 
Therefore, the mappings t z(t;zQ,u), ucE are uniformly equicontlnuous 
on [0,T] and jz(t^) - z(o) j<e,0 e for all N sufficiently 

large uniformly in k, k * 0,l,2...p^ and uniformly in u, u € E. The 
above arguments together with the Inequalities given by (3.4) imply 

In” - z(t”)| £ e(l + J (M^(o) + M2(0> {u( 0) |)da) 

0 

k-1 ft” 

+ I K K (M (0) + M (a))u(a)l)dolz” - z(t”)| 

j =0 ■'N ^ ■’ 


5 e(l + KqK^t|m^| + KqKj^Im^I t^^^|u| ) 


( 3 . 5 ) 
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+ I Ka^i f + M„(o) 1u( 0) I)d0l4 - z(t5 

j»0 IN ■ ^ ^ 


j 


for all N sufficiently large. If we now apply Lemma 3.1 to (3.5‘) it 
then follows that 


’■ I ^ e (l+Y)exp(KQKj^ I 

j=0 


k"l ft 


N 


N 


(Mj^(0) + 112(0) 


S e(l+Y)exp(KQKj^ I (Mj^(0) + M 2 (cJ) lu(0) 


s e(l-!-Y)exp(Y) 


for all N sufficiently large, inhere 


Y = K K, t[M I “f K K (m« ( T^^^|u| and the theorem is proven, 

Ui 1- Ul Z- L„ 


L L 2 

00 00 

Corollary 3.1 For | generated by an approximation scheme satisfying 

i k=0 

the hypotheses of Theorem 3.3 it follows that 


lTTlz|[((n,4>) ,u) - x(t^;Ti,(}),u) I -» 0 

as N ® uniformly in k, k « 0,1,2. ..p^ and uniformly in u, u e E 
where x denotes the unique solution to the initial value problem (2.1) (2,2). 


4. Construction of Convergent Approximation Schemes 

In this section we construct approximation schemes which are based upon 
the framework described in the previous section and which satisfy the hypotheses 
of Theorem 3,3. Since the schemes described below and the verification of 
the fact that they satisfy the hypotheses of Theorem 3.3 have appeared else- 
where ([23,[43,£83,C24]) , the relevant results are outlined and the details 
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Each of our approximation schemes is composed of two interrelated 

components, the state discretization, as is characterized by the choice of 

Z^, P^, and A^, and the temporal discretization which is determined by 

the rational functions C(z) and D(z) • The Interrelation which exists 

between the two components is a consequence of the conditions under which 

our fundamental convergence result. Theorem 3.3, applies. We begin with 

a description of two state approximations and then discuss and characterize 

families of rational functions which, when coupled with these state 

approximations lead to convergent approxlination schemes. 

The averaging state approximation (AVE) , the more primitive of the two 

state approximations to be discussed is based upon finite dlffereuce 

approximations and is defined as follows. For each N ~ 1,1... let 
N , 

Xj j * 1,2...N denote the characteristic function on the interval 
C-j-l , -< and let 

N 

Zfi {(n,4>) e Z: = J V . v e r”}. 

j=X J J J 


We note that dim = n(N + 1) and that the orthogonal (with respect to 
the standard Z inner product) projections Z^^ are given by 


P„{n,<f>) = (n, I ) 


j=i 


1 j 


where 

j r j 


(J>(9)d0. It is not difficult to show that z 

N 


as N for each z € Z. Let the operators L„:Z„ and 

N N 

DrI^N given by 



:?->l S'-"'." 

v'T'! I, , " ■ ''I 
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V N 


Lj,(n. I V X^) “ A n + I I A V x^(-T.) 
“ jal J J 1=1 j=l ^ J J , 


U N 

where A, = — 


+ - ? aN 

^ NjL Vj 
-(J-l)f 


J r J 


A(0)de j = 1.2...N and 


vn. ! v^xj) - ! f(v,.,-v^)x; 


vjhere - X] respectively* Define ^ 2^ by 

and for t ^ 0 let = e . A sequence of inner products on 

Z, 3 t>e constructed for which there exlscs an M > 0, independent 

of N, such that 


(4.1) l(n,<t)) l.. s jcn.4i)l s M!(n,<J>)lj, 

for all (r}>0) e . Furthermore, there exists a 3 > 0 Independent of 
N , for all N sufficiently large for which the operators - 3l are 
maxxmal dissipative with respect to the inner product on Z^. 

It follows therefore that e G(H,3) and |Sj^(t)| for all N 

sufficiently large. It is in fact the case that the as defined above 

satisfy a somewhat stronger condition. It can be shown that there exist 
an a > 0 for which 

n^nI ^ ^ 4 • 

. N 


(4.2) 
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apparent when we discuss the choice of the rational function component of 
the approximation scheme below. 

If we let = D(A ) and D(A) then c D(A) is a dense 

subset of 2 and for all A e C with ReA > Moreover, 

it can be shown that fo: each z e 

IVn^ - Azl = 0 (n'^^2) 

as N 

We shall next describe a spline based state approximation. The dis- 
cussions which follow will be restricted to constructions involving linear, 
or first order spline functions. However, the results given below are easily 
generalized so as to be applicable to state approximations employing higher 
order spline functions. For each N = 1,2... and 6 c C-r,0] let 


♦”(» . 


f «- > 


t ’ s e s 0 


otherwise 


^“(6) 


f <^’1-1 - «> 




otherwise 


- 1,2...H - 1 


^”(8) = 


— (t^ - 0) 

r ^ N-1 ^ 


-r < 0 ^ t 


N-1 


otherwise 


where ^ j “ ~ ^ 0,I,2...H and define by 

N 


z„ « {(<|)(0),<J') € Z: <j) = ^ V < 1 . 5 ! , V. € r’^} . 

« j«0 ^ ^ 
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It is immediately clear that dim - r(N + 1), Z^ c D(A) and Z^^ 

consists of ail those elements (n>4>) € Z for »>rhich T] *= 4>(0) auJ is a 

{ N'iN 

t, I . Let 

J I jaQ 

denote the orthogonal projection from Z onto Z^ computed with respec: 
to the weighted inner product on Z, <•,•> , defined in Secticn 2. Fiually 
we define the operators ^ 


Using the fact that the are orthogonal projections it follows from 

(2.3) that for z.. e Z„ 

N N . 


(4.3) <VN*Vg = 


<Az„ , z> ^ » z> 

N N g N* N g 


and hence that e G(/J,o)) . Furthermore, using the properties of inter- 

polatory splines it is not difficult to show that P„z z as N ~ 

N 

for each z € Z and that 


(4.4) lA^yZ - Az| = 0(N‘‘b 

for each z c = D(A ) . If we choose =“ D(A ) then all or the hypotheses 
and conditions of Theorem 3.3 concerning the state approximation only hold 
for the linear spline scheme defined above. We note that for state approxi- 
mations employing higher order spline functions the order of convergence 
in (4.4) and therefore in the integration method itself (see Remark 3.1) 
can be increased* 

For either the AVZ or spline based state aDoroximatious- a rat--foni . 





function C(z) satisfying conditions of Theorem 3*1 must be chosen for 

{ r 1 ^ N 

C(~ A^) I are uniformly bounded in N for sH N 
J1»D' . 

sufficiently large. It is clear from \-Qnd It ioa (5a) that we are seeking 
rational function approximations to the exponential. While there are many 
families of approximating rational functions from which to choose, we have 
restricted our attention to the well known Fade approximants [26] which 
are given by P^^Cz) *= Njj^(z)/Dj^(z) where 


(4.5) N (z) « y 

(j + k) !i! (k - i) I ^ 


^4.6) D-w(=) = i • 

Jk' (3 + k) !i!(j - t) !' 

It can be shown that 

jPjj^(z) - e^j = odzl^'^^'^b as \z\ -^0 

and hence the Fade approximants satisfy condition (5fe) since deg 
k - j ^ k “H 3 -P 1. It is immediately clear from (4.5), (4.6) that 




are tUo Maclaurin polynomials for e and therefore satisfy 


condition (5c) . Further lOre, Ehle [ll], in his study of the use of the 
Fade approximants in He construction of A-s table Integration schemes for 
stiff systems of ord.. ry differential equations has shown that for 
z c {z € C:Re 2 ^ 0} 


(4.7) 




j « k,k+l,k4-2 
k « 0,1,2.. . 


Consequently, from the standpoint of the constraint that condition 5 of 
Theorem 3.1 be satisfied, C(z) can be chosen from aimmg the entries in 
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the top row, the principal diagonal and the first two subdiagonals of the 
Fade table. However, the convergence of approximation schemes constructed 
using these rational functions and the AVE or spline based state approxima- 
tions defined above is guaranteed by Theorem 3.3 only if the uniform 

{ r 

A„) I can be demonstrated. 

Using the von Neumann theory of spectral sets [22] and a result due 
to Hersh and Kato [14] the following result can be obtained. 

^rheorem 4.1 Let T be a bounded linear operator on a Hilbert space H 
for which there exist a 3 > 0 such that <Tx,x> ^ 3<x,x> for all 
X e H, and let r(z) be a rational function satisfying condition 5 of 
Theorem 3.1. Then if }r(z) j 1 for all z e {ze C:Bez^0} we have 

|r(hT)l < 1 + 6Kh 


where K is a positive constant independent of h and T. 

It follows immediately from the dissipative properties of the operators 

A„ defined as a part of the AVE state approximation, (4.1), (4.7), and 
w 


Theorem 4.1 that for J » k, k -f 1, k + 2, k « 1,2... and i » 0,l,2...p, 


N 


, Me 


Me 


jk 


Similarly, for the spline based state approximations it follows from (4.3) 
that 

. o)K^ T 


In addition, for the AVE state approximation which satisfies (4.2), it 
can be shown Independently of Theorem 4.1 that for k = 1,2... and 
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Although, as far as the convergence of the approximation scheme is 
concerned, it would suffice to choose D(z) = 1 , and hence A^) « I 

(see Theorem 3.2), empirical eyidence can be given, and an intuitive 
argument can be made for choosing D(z) as a rational function approxima'* 
tion to the exponential. It is easily verified that any rational function 
approximation to the exponential which is a suitable choice for C(z) is 
a suitable choice for D(z) as well. In addition, for the spline based 
state approximations and k =» 1,2... it can be shown that 
jP^^(A-~ A^)F^z 2 I 0 as N > ^ for each z e Z, A more detailed 
description of the role played by the rational function D(z) and its 
effect upon the overall pertormanco of the approximation scheme can be 
found in [24]. 

The results in this section are summarized in the following theorem. 

Theorem 4.2 For C(z) ,D(z) ) an approximation scheme for the 

initial value problem (2.1) (2. 2), the hypotheses and conditions of Theorem 
3.3 are satisfied if 

(1) Z^, P^, is an AVE state approximation and 
C(z),D(z) 

or 

(2) Ajj is a spline based state approxiraatlon, C(z) e 
and D(z) e 

where ^ = IP . (z)} j = k,k+l,k+2, k = 1,2... and ^ = {P., (z)} k = 1,2 

P JK p UK 
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5, Appllcatiou to Optimal Control Problems 

In this section we consider the application of Che approximatioh 

results discussed above to the solution of optimal control probleras in 

which the state is governed by a nonlinear hereditary system of the 

n 1 n i 

form (2.1) • In particular let be continuous 

and let (1)^:L2(0,T) be continuous and convex. Let U be a closed 

convex subset of L®(0,T) and define problem (P) as follows 

(P) 

Minimize ^(u) == (J>^(x(T;n»4>»u)) + 

over ail u c U where x(*;n,4^,u) denotes the unique solution to 
(2.1), (2. 2) corresponding to u € U. 

The approach we take is to consider a sequence of approximating optimal 
control problems {(Pj^)) > in each of which the governing state equation is 
a finite dimensional discrete difference equation constructed in accordance 
with the approximation framework developed in Section 3. Let 
{Z^,P^,A^,C( 2 ) ,D(z) } be an approximation scheme for (2.1)<2.2) which 
satisfies the hypotheses of Theorem 3.3 and for z^ = (n»4^5» n e L^COjT) 
and k = 0,l,2...p^ let 

Zy.izQ,n) « (Xj^(zQ,u).yj^(2Q,u)) 

where |z|^(zq,u)| ^ are given by (3.3) with x^(Zq,u) € and 

KT k*®^ M 

yj^(zQ,u) e L^CO.T). Define x £ L^CO.T) by 

x®(e) = x^(e;n,it»/U) = I x^(z ,u)x _ ■ (6) 

j»0 ^ ^ 
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and for each N * 1,2.. . let problem (P^j) be given by 


(P^) 


Minimize = 4>j^(Xp (Zq.u)) + 


over all u e U. 


R emark 5.1 While it is true that for each N = 1,2.,. problem (P^) 

is not fully discrete in that the minimization of $ is being considered 

over a function space, it is in fact possible to define the problem In a 

form which is directly suitable for solution on the computer. Indeed, if 

we consider the minimization over the set L" = Q„U c x E 
^ ■ N N ^ 

m m 0 

Q :L"(0,T) X r“ is defined by 
0 ^ 

J+li 


m 


where 


(Q,u)j = f 


u(T)dT j * 0,l,2...p”-l, 


T 


then by placing relatively minor restrictions on the choice of the set U , 
all. of the convergence results for the solutions to the sequence of problems 
{(P^)} to be discussed below can be shown to hold for the fully discrete 
problems as well. In order to simplify the presentation, however, we shall 
restrict our attention to the approximating problems as given. 

It is our ultimate goal to demonstrate that in some sense, solutions 
to problem (P^) approximate solutions to problem (P) . However before 
this can be accomplished, the existence of solutions to problems (P) and 
(P^) must be considered. In order to insure the convexity of and 

with respect to u it is necessary that we restrict f , the nonlinear 
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Cl f 'V^l 
v*r -n.eri 

part of the state equation to be affine in the controls* Following 
Banks [2], henceforth we shall assume that f :R^xR^xL2(-‘r,0)xR°^ 
is of the form 

(5.1) f(t,n,<f>»v) » f^(t,n><}^) + (f^Ct,!!,^) B(t))v 

where B is continuous and f^rR^xR^^xL^C-rjO) -► R^ and 
f 22 R^^R^^L 2 (-r, 0 ) R^^ satisfy the following hypotheses. 

(1) The mappings <t,ri,4>) f^(t,n,4>) i “ 1,2 

are continuous on R^xR*^xL^(-r ,0) . 

(2) For any bounded subset P of R^xL^C^r/O) 

there exist m =* ni (P) , m. e i == 1,2 such 

X 1 X 

that for t € R^ and e V one has 

(3) For i « 1,2, f^(t,0,0) - 0 and there exist functions 

m. € such that for t e R^ 

i CO 

|f^(t,n,c}))l ^ %(t){ln|+|4!} 

for (n,4>) e R^xL”(-r,0) with |n) + |<l>| sufficiently large. It is 
immediately clear that any function f of the form (5.1) satisfying 
(1) - (3) above will also satisfy hypotheses (H1)~(H4). 

In addition, it is necessary that we make either one or the other of 
the following two assumptions 

(Al) The set U is bounded 

(A2) The mappings i = 1,2,3 satisfy 

(i) ^ 0 i « 1,2 

(ii) 4 >q(u) if |ul 


“>■ oo • 



We note that problem (P) is most commonly stated with U = L^COs^T) 
and ^ a quadratic of the form 

(5.2) ‘J'(u) “ x{t;n.'J),u)'^Gx(T;n,<j),u) + 

,T .T 

x(s{rii<|).u)^Qx(s;n»<|)t«)<is + I u(8)^Ru(s)ds 
0 0 

where G and Q are positive serai-definite nxn raatricea and R is a 
positive definite raxm matrix. In this case, assuniption (A2) holds. 


Lemma 5.1 

For f 

of the form (5.1) 

satisfying hypotheses (1)~(3), 

Zp € Z and u^ u 

weakly in ^^(O,!’) 

we have 

(5.3) 

lz(t;zQ,Uj 

,) - z(t;ZQ,u) ! ■*• 0 



as i ^ uniformly in t for t € [G,T] and for N = 1,2. .. fixed we have 
(5.4) Iz^CZq.Ujj^) - z^(Zq,u) | -*- 0 

as I -> <» uniformly in k for k - 0,1,2. ..p^ where z(t;z^tu) and 
N 

Zj^(Zo.u) are given by (2.4) and (3.3^ respectively. 

The proof of (5.3) follows from Theorem 3.2 of [2] while similar 
arguments and Lemma 3.1 can be used to verify (5.4), 

Corollary 5.1 Under the hypotheses of Lemma 5.1, if is a sequence 

in 1^(0 ,T) for which u weakly then 

" 2(t^;zQ,u>l -»• 0 

as N CO uniformly in k, k « 0vl>2,..pj^, 
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Proof Since 

(5.5) 1zJJ(zq,Ujj) - z(t”;zQ,u) I 

!z”(Zo*“n^ “ I 

and -► u weakly implies that lies in a bounded subset of 

L^COjT), the first term on the right hand side of (5.5) tends toward 
xero as N uniformly in k, k « 0,l,2...p^ as a consequence of 

Theorem 3,3 while Lemma 5.1 insures that the second term tends toward 
zero in the stated manner as well. 

Theorem 5.1 If either assumption (Al) or (A2) hold and f is of 
the form (5.1) satisfying hypotheses (l)-(3) then problems (P) and 
(P^) have solutions. 

Proof Lemma 5.1, continuous, i 1,2,3 and <{)^ convex imply that 

^ and are weakly semi-continuous from below. Therefore, if U is 

bounded, ^ and will assume their infimum on U (see Il9l Existence 

N 

Theorem, page 90) and the theorem is proven. 

On the other hand, suppose Assumption (A2) holds, and let {u^} e U 
be such that 

4>(u^ ^ a » inf {^(u) :u € U). 

Note that 4^^ > 0 i » 1,2,3 implies that 0 ^ a < Since U Is 
closed and convex (and therefore weakly sequentially closed) and 
is bounded (Assumption (A2)) , must contain a weakly convergent sub- 

sequence {u. }, u. u € U, weakly. However, $ weakly semi-continuous 
3 j 
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from below implies that 

a S <f(u) s lim inf .^(u. , ) » a . 

and hence $(u) “ a , and u is a solution to problem (P). A similar 

argument may be used to demonstrate the existence of a solution u„ e U 

« 

to problem (P^) • 


Theorem 5.2 Suppose that the hypotheses of Theorem 5.1 hold and for each 

K « l,2.. .,u^^ denotes a solution to problem (Pj|) • Then contains a 

subsequence } for which u e U weakly. Moreover, u is a 

k _ 

solution to problem (P) and ^ (u ) $(u) as k 

Proof Under either assumption (Al) or (A2) the sequence {u ,} is 
“ . N 

bounded. It therefore must contain a weakly convergent subsequence {u^ }. 

If u € U is such that u weakly as k chen Corollary 3.1, 

Corollary 5.1 and the weak semi -‘continuity from below of 4)^ (it being 
continuous and convex) imply that 


4>(u) » 4)^(x(T;n,(}),u)) + 4>2 (x(* ;n4 »u)) + <j>^(u) 

N _ 

k~K» k k-H» ^k 

+ lim inf ) 

k-Kx> k 

= lim inf $. ku ) s lim sup Kfn ) 

. k-K» k k kr^ k k 


< lim sup (u) — lira qj., (u) = 4>(u) 
k-H» % \ 

for arbitrary u e U , and hence that u is a solution to problem (p) . 

The fact that (u^ ) ^ ^(u) as k “ follows from 

<Ku) ^ lim inf (u^ ) lim sup (u ) 
k-x» \ \ k-K« \ \ 

lim sup (u) s= lim (u) - 


5 



Remark Since it is difficult to determine the convexity properties of the 


functional it is not possible to say anything about the uniqueness of 
solutions to problem (P). However, if in fact problem (P) has a unique 
solution, then the sequence itself, {\x^} will converge to u weakly as 
N 


Remark If ^ is of the form (5.2) then it is possible to show that 

|u^ I |u| as well, and hence that -► u strongly as k Once 

again«,if problem (P) admits a unique solution u, then u^ u strongly 
as N oo, 

6 • Analysis of Numerical Results 

In this section we present numerical results obtained through the 
implementation of the approximation schemes described above. The schemes 
employed have been constructed using the AVE and spline based (SPL) state 
approximations together with the Fade rational function approximations to 
the exponential. In all of the examples below, however, we have chosen 
CCz) » D(z) “ ^22^^^ ^ ^ effect of varying the choice of the 

rational function components of the approximation scheme (from among those 
in the Fade table for which the hypotheses of Theorem 3.3 are satisfied) * 
was studied extensively in [24]. 

We have included one example involving the integration of an initial 
value problem of the form (2.1) (2. 2) only and three other examples which 
involve the solution of an optimal control problem of the form given by 
problem (P) in Section 5. We have deliberately chosen to include examples 
which have been used by other authors to test other approximation schemes 
for the integration of FDE and the solution of FDE control problems so that 


our methods can be compared to theirs. The other places where each e^o^ple 
has appeared has been so noted* 


All programming was done in FORTRAN and implemented on the Digital 
Equipment Corporation DEG system 10 computer at Bowdoin College. The 
optimization In each of the approximating problems (P^) was carried out 
using the IMSL ClS] routine 2XMIN, an iterative quasi-Newton algorithm 
for finding the minimum of a scalar valued function of several variables, 

The discretization of the admissible control space U in the approximating 
optimal control problems (F^) was done in two different ways. One Involved 
the use of the space U - x as an approximation to l!?{ 0,T) (see 

IM Q L 

Remark 5.1), In this case the number of parameters over which the minimi- 
zation takes place increases with the degree of approximation N. The 


^ L 

second approach was to minimize over the space U ** x where L is a fixed 

0 

constant independent of N. A cubic spline interpolation scheme was then 
used to obtain the values of the control which are required to evaluate 
(3.3). The approximate solutions resulting from the two methods were 
virtually indistinguishable. However, the number of iterations required 
to obtain the minimizing control increased like 0(N) for the first method; 
while the iteration count remained essentially constant for all values of 
N for the second method. 

Since, with the exception of Example 6,2 which has a linear state 
equation, it is impossible to obtain exact solutions to the optimal control 
problems below, we have included approximata solutions which were obtained 
using methods Independent from our own. These alternate approximate 
solutions, which can be used for comparision, were computed by Daniel [lO] 
using a fourth order integration scheme for FDE developed by Tavernini [25] 
to solve the mixed ret araed/ advanced two point boundary value problem which 
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Example 6>1 (Banks [2], Example 4,1) 

We consider the integration of the equation 

x(t) « -1.5x(t) - 1.25x(t“l) + x(t)3inx(t) 

on the interval 0 ^ t 5 with Initial data 

x(0) = 1 Xq(s) * 10s 4* 1 -1 ^ s 0 

The approximate solutions generated by the AVE and SPL state approximations 
are given in Tables 6.1 and 6.2 respectively. The values in the last column 
of each of the tables were computed using the method of steps [12] togc cher 
with a fourth order Runge-Kutta routine for ordinary differential equations 
and may be used for comparison purposes. 


B 

AVE.^v 
\ (t) 

AVE.^. 

Xg (t) 

AVE, . 

*16 

B99| 

x(t) 

0.0 

1.0 

i.o 

1.0 

1.0 

1.0 

.5 

3.0954 

3. 1924 

3.2531 

3.2840 

3.3142 

1.0 

2.1375 

2.2051 

2.2522 

2.2841 

2.3317 

1.5 

.9759 

. 7151 

.5163 

.3877 

.2294 

2.0 

- .2258 

- .6233 

- .8116 

- .9020 

- .9909 

2.5 

- .5984 

- .6920 

- .7221 

- .7331 

- . 7399 

3.0 

- .3491 

- .2599 

- .1715 

- .1073 

- . 0245 

3.5 

- .0573 

.1091 

.2409 

.3251 

.4259 

4.0 

. 1024 

.2389 

.3244 

.3711 

.4195 

4.5 

1.2229 

.1598 

.1532 

.1370 

.1081 

5.0 

.0634 

.0150 

- .0469 

- .0919 

- .1480 


Table 6.1 
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B 

(t) 

SPL, , 

Xg (t) 

*16 

SPL. . 
*32 

x(c) 

0, 0 

1.0038 

1.0010 

1.0003 

1.0001 

1.0 

.5 

3.5036 

3. 3623 

3.3344 

3.3236 

3,3142 

1.0, 

2,1694 

2.2636 

2.2992 

2.3157 

2.3317 

1.5 

.3642 

.2834 

.2538 

, 2405 

.2294 

2.0 

-1.0308 

- .9972 

- .9929 

- .9919 

- .9909 

2.5 

- . 7248 

- .7332 

- .7345 

- . 7367 

- . 7399 

3.0 

- .0612 

- .0218 

- .0188 

- .0205 

- .0245 

1 

3.5 

. 4055 

. 4166 

.4230 

.4251 

.4259 

4.0 

. 4180 

.4145 

.4157 

.4173 

.4195 

4.5 

.1572' 

.1187 

. 1099 

.1081 

. 1081 

5.0 

1 

- .1124 

1 

- .1391 

- .1454 

- .1473 

- .1480 


Table 6.2 


Example 6.2 (Banks, Burns, Cliff [5], Example C7, Rockey [23], Test Problem 5.6) 
In this example we consider an optimal control problem whose state 

equation is a linear harmonic oscillator with delayed damping. 

.2 

Minimize ^(u) = 5y(2)^ -f A I u(s)^ds 

0 

over u € U » L^CO^Z) subject to 
(6.1) y*(t) + f(t-l) + y(t) = u(t) 


with initial conditions 


(6.2) 

y(0) = 

10 

yQ(s) = 10 


s ^ 0 

(6.3) 

y(0) = 

0 

YqCs) = 0 

-1 < 

s ^ 0 

For this 

problem. 

the 

true optimal 

control 

u may be computed, and is given 
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t 

— _ — ^ — 

-AVE. . 

“4 (t) 

-AVE. . 

U 3 (t) 

^^16 

0.0 

1.2757 

1.2797 

1.2746 

.25 

1.4515 

1.6358 

1.7463 

.50 

1.7195 

1.9506 

2.0888 

.75 

1.8076 

2.0427 

2.1827 

1.00 

1.7070 

:.9094 

2.0263 

1.25 

1.4333 

1..'.844 

1.6641 

1.50 

1.0255 

1.1236 

1.1718 

1.75 

. 5324 

.5794 

.6043 

2.0 

.2708 i 

.1473 

n7 7A 


-AVE. . 

*•32 


1.2336 
1.8024 
2.1706 
2.2642 
2.0911 
1. 7075 
1. 2018 
.6164 


3.2506 

1.3645 

2.2467 

2.3501 

2.1541 

1.7449 

1.2273 

.6333 










t 

-SPL.^. 

(t) 

_SPL,^. 
Ug <t) 

mmi 

-SPL. . 
U 32 (t) 

u(t) 

0.0 

1,6887 

1.4468 

1.3456 

1.2776 

1.2506 

.25 

1.9415 

1.8856 

1.8748 

1.8686 

1,8645 

.50 

2.3024 

2.2635 

2.2553 

2.2501 

2,2467 

.75 

2.3675 

2.3570 

2.3583 

2.3521 

2.3501 

1.00 

2.1634 

2.1573 

2.1482 

2.1539 

2.1541 

1.25 

1.7592 

1.7489 

1.7458 

1.7443 

1.7449 

1.50 

1.2238 

1.2269 

1.2261 

1.2276 

1.2273 

1.75 

.61496 

.6301 

.6285 

.6339 

.6333 

2.0 

.2999 

.1548 

.0798 

.0392 

0.000 


3.5664 

3.4438 

3.411 

3.4021 

3.3991 


Table 6.4 


Example 6.3 (Banks [2], Example 4.4, Banks, Burns, Cliff [5], Example Cll, 
Daniel ClO], Example 4.5, Hoekey [23], Test Problem 5.10) 

In this example we consider an optimal control problem with a one 
dimensional nonlinear state equation 

Minimize $(u) =-|x(2)^+i 

over u £ V^i0,2) subject to 

x(t) « x(t-l) + x(t) sin x(t) 


I x(s)^ + u(s)^ds 
0 


+ u(t) 


with initial conditions given by 

x( 0 ) =0 Xq(s) = 


- 10 s 

lO(shl) 



- 1 < 


s ^ 0 

s.i 


The approximating minimizing controls for the AVE and SPL state approxi- 
mat ions are given in Tables 6.5 and 6.6 respectively while Tables 6.7 and 
6.8 contain the corresponding optimal trajectories. 
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t 

^4 (t) 

-AVE. . 

Ug (t) 

^6 

-AVE- . 
'^32 

u(c) 

0.0 

-2.1967 

-2.2417 

-2.2681 

-2.2817 

-2.3028 

.25 

-2.0860 

-2.1699 

-2.2295 

-2.2662 

-2.3164 

.50 

-1.8082 

-1.9655 

-2.0971 

-2,1893 

-2.3189 

.75 

-i.46C5 

-1.5635 

-1.6386 

-1.6853 

-1,7470 

1,00 

-1.1242 

-1,1470 

-1,1443 

-1.1333 

-1.1031 

1,25 

- .8467 

- .8273 

- .7972 

^ .7747 

- .7483 

1,50 

- .6332 

- .6072 

- .5838 

- .5708 

- .5619 

1.75 

- .4665 

- ,4484 

- ,4376 

- .4349 

- .4440 

2.0 

- .3921 

- .3477 

- .3282 

- .3223 

- .3230 

V<“n> 

1.9914 

2.1673 

2.3020 

2.3953 



Table 6.5 


t 

_SPL. . 

“4 

Ug (t) 

»16 

-SP~L/..a 1 

U 32 (t) 

u<t) 

0.0 

^2.2389 

-2.2372 

-2.2596 

-2.2741 

- 2 . 302 s 

.25 

-2.3139 

-2.3019 

-2.3023 

-2.3041 ’ 

-2.3164 

.50 

-2.1999 

-2.2596 

-2.2908 

-2.3022 i 

-2.3189 

.75 

-1.6929 

-1.7129 

-1.7295 

-1.7364 

-1.7470 

1.00 

-1.1384 

-1.1198 

-1.1117 

-1.1070 

-1.1031 

1.25 

- .7830 

- .7702 

- .7610 

- .7569 

- .7483 

1.50 

- .6151 

- ,5874 

- .5749 

- .5682 

^ .5619 

1.75 

- .5032 

- .4543 

- .A531 

- .4469 

- ,4440 

2.0 

- .4417 

- .3676 

- .3461 

- .3351 

- .3230 


2.5119 

2.4996 

2.5103 

2.5133 



Table 6.6 
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t 

-AVE.^. 

(t) 

-xr<.) 

’^16 

-ave,^ ■ 

X32 <t) 

x(t) 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

.25 

- .0087 

- .1034 

- .1672 

- .2051 

- .2473 

.50 

.1537 

,1434 

.1357 

.1271 

.1078 

. 75 

.2757 

.3540 

.4329 

.4931 

.5663 

1.00 

. 3282 

.4199 

.5009 

.5562 

.6186 

1.25 

.3368 

.3901 

.4182 

.4259 

.4127 

1.50 

.3314 

.3393 

. 3233 

.3006 

.2474 

1.75 

. 3337 

. 3139 

.2886 

.2687 

.2272 

2.00 

. 3486 

. 3264 

. 3165 

. 3159 

.3053 


Table 6.7 


t 


xfNt) 

(t) 


S(t) 

0,0 

- .0034 

,0010 

- .0003 

- ,0001 

0.0 

.25 

- .2538 

“ .2415 

- .2425 

- ,2440 

- .2473 

.50 

,1721 

.1259 

.1155 

.1136 

.1078 

.75 

.6048 

.5994 

.5749 

.5737 

.5663 

1.00 

.6607 

.6234 

.6257 

.6278 

.6186 

1.25 

.4115 

.4222 

.4222 

.4231 

.4127 

1.50 

.2005 

.2599 

.2665 

.2629 

.2474 

1.75 

.2398 

.2617 

.2494 

.2456 

.2272 

2.0 

.4021 

.3485 

.3359 

.3282 

.3053 


Table 6.8 
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Example 6.4 (Daniel [iO], Example 4.2) 

In this example we consider an inertial control problem (see [9]) 

f2 


Minimize $(u) = y(2)^ ^ ^ | ^ 


(s) ^ds 


over u € U ~ {u€ H^(0,2) ;u(0) « O} subject to 


y(t) « y(t-l) + ^ t^siny (t) + u(t) 


with initial conditions 


y(0) « 1 ^ 


•1 ^ s ^ 0. 


Although this example is not in the form of problein (P) it can be trans- 
formed into an equivalent optimal control problem to which the theory 
developed above applies. If we let 


x(t) 


y(t) 


v(t) * u(t) 


then the problem becomes 


Minimize $(v) » x(2)” 


2 " 
0 0 


x(2) 


1 f' 

2 J ^ 


(s)^ds 


over V € (0^2) subject to 


x(t) = 

0 1 


1 0 


1 .2 ^ ' 
— t sin X, (t) 


X(t) + 


x(t-l) 4- 



_0 


-0 0- 


__ v(t) _ 


with initial conditions 

*1 

x'(0) 


XqCs) 


1 

0 


-1 < s ^ 0 
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The approximating optimal controls given in Tables 6.9 

and 6 , 10 , and the corresponding optimal trajectories 7 ^ 
in Tables 6.11 and 6.12, 


rt 

-AVE,^. 
\ (t) 

-AVE,^. 

Ug (t) 

-AVE. - 
“16 

-AVE.^. 

^32 

u(t) 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

.25 

- .6687 

- .6836 

- .6870 

- .6880 

- .6858 

.50 

-1.2308 

-1.2329 

-1.2332 

-1.2336 

-1.2291 

.75 

-1.6634 

-1.6569 

-1.6555 

-1.6558 

-1.6494 

1.00 

-1.9840 

-1.9723 

-1,9707 

-1.9714 

-1.9645 

1.25 

-2.2083 

-2.1937 

-2.1932 

-2.1950 

-2.1891 

1.50 

-2.3520 

-2.3349 

-2.3352 


-2.3332 

1.75 

-2.4293 

-2.4095 

-2.4098 

-2.4132 

-2.4087 

2.00 

-2.4644 

-2.4342 

-2.4320 

-2.4349 

-2.4303 

MM 

2.5484 

2.4804 
1 ^ ^ 

2.4617 

2.4570 



Table 6.9 


rt 

-SPL,^, 

(t) 

-SPL.^. 

Ug (t) 

-SPL. . 
“16 

U 32 (t) 

0 (t) 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

.25 

- .6491 

- .6799 

- .6860 

- .6877 

- .6858 

.50 

-1.2161. 

-1.2282 

-1.2319 

-1,2331 

-1.2291 

.75 

-1.6506 

-1.6524 

-1.6539 

-1.6553 

-1.6494 

1.00 

-1.9727 

-1.9692 

-1.9699 

-1.9716 

-1.9645 


-2.2070. 

-2.1957 

-2,1950 

-2.1966 

-2.1891 


-2.3639 

-2.3436 

-2.3404 

-2.3411 

-2.3332 

1.75 

-2.4483 

-2.4207 

-2.4157 

-2.4167 

-2.4087 

2.00 

-2.4816 

-2.4447 

-2.4382 

-2.4388 

-2.4303 

'I' ( u ) 
n'- N '' 

2.5826 

2 .4986 

2.4719 

2.4624 



Table 6.10 
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-AVE.^. 

-AVE,^. 

Xs (t) 

*16 


5(t) 

a 

1.0000 

1.0000 

1.0000 

1.0000 

1.0000 

.25 

1.1698 

1.1654 

1.1638 

1.1633 

1.1636 

.50 

1.2019 

1.1911 

1.1881 

1.1873 

1.1889 

75 

1.1454 

1.1273 

1.1213 

1.1193 

1.1228 

1.00 

1.0462 

1.0208 

1.0095 

1.0034 

1.0041 

1.25 

.9371 

.9066 

.8919 

.8835 

.8862 

1.50 

.8376 

.8031 

.7878 

. 7805 

.7927 

1.75 

.7590 

.7178 

.7008 

.6932 

.7167 

2.00 

.7103 

.6561 

.6315 

.6195 

.6564 


Table 6.11 


t 

-SPL,,. 

^4 (t> 

Xg (t) 

-SPL. . 
*16 

-SPL,^. 

X 32 (t) 

x(t) 

a 

1.0000 

1.0000 

1.0000 

1.0000 

1.0000 

.25 

1.1703 

1.1662 

1.1639 

1.1633 

1.1636 


1.2102 

1.1932 

1.1887 

1.1875 

1.1889 

.75 

1.1500 

1.1279 

1.1214 

1.1195 

1.1228 

1.00 

1.0418 

1.0111 

1.0017 


1.0041 

1.25 

.9340 

.8944 

.8824 


.8862 

1.50 

.8507 

.8055 

.7875 

.7799 

.7927 

1.75 

. 7949 


.7084 

.6968 

.7162 

2.00 

.7674 


.6440 

. 6252 

.6564 


Table 6.12 


Based upon the examples presented here, and several others which we 
have looked at, the following observations can.be made. 
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(1) The schemes which we have -proposed represent feasible and relatively 
efficient approximation methods for solving certain classes of non- 
linear hereditary control problems, 

(2) Since the resulting approximating problems are governed by discrete 
difference equations the programming required is relatively simple. 
Moreover, since no additional discretization Is necessary when the 
schemes are implemented on the computer, no further stability 
analysis is required in order to guarantee convergence of the 
approximating solutions. 

(3) The spline based schemes, although somewhat raore difficult to 
program and costlier to run, out --per form the averaging schemes. 
However, tne difference appears to be more pronounced in the case 
of simple integration of initial value problems as opposed to the 
solution of optimal control problems. 

(4) The accuracy of the approximating optimal controls and trajectories 
is quite good even for relatively small values of N . This is 
especially true for the schemes employ ing the spline based state 
approximation. 

(5) Our results are comparable to those obtained by Roekey [25] and 
to those obtained via the semi-discrete schemes developed by 
Banks [2] [5] and Daniel [103. 
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We have also applied our schemes to the design of an open loop 
controller for the mach number - guide vane angle control loop of the 
i>fational Transonic Wind Tunnel Facility (NTF) at the NASA Langley Research 
Center in Hampton, Virginia (see [l3,ClO]) - Although the operation of the 
NTF is best described by a complex system of nonlinear partial differential 
equations, the dynamics of the system near steady state operating conditions 
can be modeled by a linear hereditary system in which either the guide 
vane angle actuator, or the guide vane angle actuator rate act as a control. 
If we assume that a disturbance has occurred at time t == 0 , the problem 
is to choose the control so as to drive the system back to equilibrium 
as quickly as possible without exceeding the physical limitations of the 
components of the system. This leads to a linear quadratic optimal control 
problem in which the dynamics are governed by a linear FDE of the form (2,1) 
with f (t,r|,(J),u) = Bu. While an approximation to the closed loop solution 
to this problem (in the form of approximating feedback gains matrices) would 
be more desirable (and is accessable through the techniques discussed in 
[7] [133 and [20}) we have generated approximating open loop solutions 
using the schemes developed above. This permitted us to test our methods 
on systems of higher dimension (n « 3 and 4) with the optimization being 
carried out over an extended time interval (T - 30) , Both the averaging 
and spline based state approximations were employed with values of N as 
large as 24. We compared our results to the open loop solutions to this 
problem which appear in [10 3 and to the open loop form of the closed loop 
solutions computed in [l3 and [73. Our schemes performed comparably, both 
qualatatively and quantatatively , and provided acceptable approximating 
solutions for all values of N i 4 . 
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